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Abstract 

We investigate a generalised version of the recently proposed ordinal partition time series 
to network transformation algorithm. Firstly we introduce a fixed time lag for the elements 
of each partition that is selected using techniques from traditional time delay embedding. 

The resulting partitions define regions in the embedding phase space that are mapped to 
nodes in the network space. Edges are allocated between nodes based on temporal succes¬ 
sion thus creating a Markov chain representation of the time series. We then apply this 
new transformation algorithm to time series generated by the Rossler system and find that 
periodic dynamics translate to ring structures whereas chaotic time series translate to band 
or tube-like structures — thereby indicating that our algorithm generates networks whose 
structure is sensitive to system dynamics. Furthermore we demonstrate that simple network 
measures including the mean out degree and variance of out degrees can track changes in the 
dynamical behaviour in a manner comparable to the largest Lyapunov exponent. We also 
apply the same analysis to experimental time series generated by a diode resonator circuit 
and show that the network size, mean shortest path length and network diameter are highly 
sensitive to the interior crisis captured in this particular data set. 
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Within the last ten years a novel approach to time series analysis has emerged 
whereby data is transformed into a complex network and then analysed using var¬ 
ious measures from network science. The choice of transformation algorithm is 
critical in this process as different methods are inherently more effective at cap¬ 
turing certain aspects of dynamics and less effective at capturing others. In this 
paper we investigate a recently proposed algorithm known as the method of ordi¬ 
nal partitions. This computationally simple algorithm explicitly embeds temporal 
information in the network structure by partitioning the time series into a set of 
symbolic states which become network nodes, and then connecting these nodes 
based on the transition sequence present in the data. New in this work, we gen¬ 
eralise the algorithm by introducing a time lag parameter for the elements in each 
partition, as is done in traditional methods of time delay embedding. Our results 
demonstrate that this new approach generates networks which are measurably sen¬ 
sitive to the dynamics present in the source time series, and has the potential 
to be useful as a tool for change point detection in continuous chaotic systems. 


1 Introduction 

Various procedures for mapping time series data to networks have attracted significant interest 
in recent years as a novel means of analysing complex dynamical systems. The existing gamut of 
time series to network transformations can be broadly classified as either proximity networks, 
visibility graphs or transition networks, as defined in the thorough review paper by Donner 
et al. [T]. While there is a significant body of work concerning proximity network methods, 
those which build networks based on the proximity of embedded time series points in phase 
space, they do not explicitly capture temporal information. The same can be said for the 
various visibility graph algorithms which have won favour for their computational simplicity 
and findings linking aspects of resulting networks’ degree distributions with the Hurst exponent 
for time series generated by fractal Brownian motion [2]. 

Several methods exist for building transition networks from time series where nodes are 
representative of states and edges are allocated based on temporal succession. These include 
coarse graining the phase space of an embedded time series [am, partitioning a one dimensional 
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set of observations by quartiles [5] , or by the recently proposed method of ordinal partitions [6] 
which is an extension of the concept of permutation entropy [7j from the field of symbolic 
dynamics. The last of these three methods presents the advantage that it is relatively robust to 
noise [8] and small variations in amplitude are not discarded as a result of the coarse graining 
process. 

In this work we define a generalised form of the ordinal partition time series to network 
transformation algorithm, unique at the time of this publication, and investigate its applica¬ 
tion to time series generated by chaotic flows, for both model systems and experimental data. 
In Section we present a review of the relevant existing methods that transform time series 
into networks. Section comprises the generalised definition of the ordinal partition network 
transformation method. We apply the method to the Rossler system and present results regard¬ 
ing network structure, discuss the selection of the embedding dimension and demonstrate the 
potential for tracking changes in dynamics in Section]^ The same tests are performed on exper¬ 
imental data generated by a diode resonator circuit in Section before concluding statements 
in Section [6l 

2 Review 

2.1 Proximity Networks 

Proximity network methods include cycle networks [9], correlation networks m and, most 
prominently, networks based on proximity in phase space mm- These algorithms map states 
from the time series, which are commonly the states of the embedded time series but can also 
be cycles from pseudo-periodic time series [9] or coarse grained amplitudes m, and allocate 
edges between these states based on some measure of closeness or similarity. 

Proximity networks therefore have the potential to capture significant information about 
attractor topology. For example, various measurable properties of proximity networks includ¬ 
ing node degree, clustering, betweenness centrality and network diameter have been linked to 
attractor density and heterogeneity or homogeneity in phase space by Xiang et al. m and 
Donner et al. [15]. In jlTj, Marwan et al. used the clustering coefficient to detect changes 
in dynamics using the proximity network paradigm as applied to the logistic map and paleo 
climate data. More recently degree variance was shown to track changes in dynamics along the 
bifurcation spectrum of the Rossler system [T3], and in |16] Iwayama et al. developed a spectral 


3 


clustering measure for proximity networks and used this in conjunction with surrogate data for 
change point detection in both Rossler and Lorenz systems. 

Several methods have been proposed for the classification of dynamics using proximity net¬ 
works. The distribution of node degrees in proximity networks was the subject of early research 
by Zhang and Small [9] , and Yang and Yang m with the former reporting that cycle networks 
could be used to identify chaotic dynamics in flows as distinct from noisy periodic signals based 
on the observation of a scale free or random degree distribution respectively, and when applied 
to ECG data demonstrated the potential for the method to discriminate between healthy and 
unhealthy heart function. More recent research by Zou et al. HZ! uncovered power law degree 
distributions in recurrence networks generated from a variety of deterministic test systems and 
experimental data, and showed that the power law exponent is directly related to the invariant 
density of the underlying systems. Furthermore, a cubic polynomial relationship between the 
Hurst exponent of a fractal Brownian motion time series and the power law exponent of the 
degree distribution of the corresponding recurrence network was reported by Liu et al. in |18j . 
Ranking the distribution of motifs in recurrence networks has also proved a robust procedure 
for classifying dynamical behaviour in both maps and flows as originally proposed by Xu et 
al. [12| with further contributions in |14) and |18j . 

While the above highlights the potential of proximity networks for use in practical time 
series analysis, the primary drawback of most of these methods is that the resulting networks 
are invariant to the relabelling of nodes and hence do not explicitly preserve temporal informa¬ 
tion. Some exceptions do exist, however, including in m where the authors have deliberately 
added links based on temporal adjacency, in contrast to the general approach where temporally 
adjacent nodes are sometimes even deliberately disconnected [1|. A new proximity method was 
recently introduced where nodes (times series points) are connected based on a threshold of 
relative amplitude m- It was demonstrated that this method was able to transform a time 
series into a network and then generate a new time series from that network such that both the 
original and the new time series were highly correlated, indicating that temporal information 
was embedded in the network structure. This result is intuitive given that for an appropriate 
sampling rate and threshold all temporally adjacent points will be connected, hence this algo¬ 
rithm straddles both the proximity network and transition network paradigms. It is important 
to note that in both of these cases the network edges which represent a temporal transition 
are not distinct from those allocated based on proximity. These exceptions aside, however, 
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proximity networks enable us to measure aspects of attractor topology and not the evolution 
of trajectories. It is for this reason that we elect to investigate a transition network method in 
this work. 

Furthermore, most proximity methods also require time delay embedding and the selection 
of a third parameter which is generally a proximity threshold or a fixed node degree. Proper 
selection of these parameters is critical to the structure of the resulting networks. For example, 
incorrect embedding or a poor choice of threshold can result in disconnected structures or false 
neighbours. A detailed discussion of these issues with respect to the various different proximity 
network types is presented in [T]. A final practical consideration with regard to proximity 
networks is that the size of the networks produced scales directly with the size of the dataset. 
By contrast, the new method presented in this paper generates networks whose size is dependant 
on the attractor topology, specifically, the volume of phase space occupied by the underlying 
attractor, as will be discussed. 

2.2 Visibility Graphs 

The second broad class of time series to network transformation algorithms are visibility graphs. 
First proposed by Lacasa et al. mm. these are computationally simple algorithms, that map 
each point in the time series to a node and connect the nodes based on the convexity of successive 
observations. Aside from several recent extensions proposed for specific tasks |2nt I21|. visibility 
graph methods are parameter free. Research has demonstrated links between scale free networks 
and fractal time series [2], and that the degree distributions of visibility graphs generated from 
fractal Brownian motion are a function of the Hurst exponent |19j . Visibility graphs capture 
some aspect of temporal information (although they do not do so explicitly). This characteristic 
has been exploited to test the reversibility of time series, including EEG data, without the need 
for surrogate data |22j . The visibility graph algorithm is attractive for its simplicity and that 
it can be applied to data without the need for parameter selection, however it is not clear as to 
which aspect of the dynamics is being embedded in the networks. 

2.3 Transition Networks 

Transition networks are a simple way of conceptualising a time series based on temporal infor¬ 
mation. Algorithms of this type generally map time series data to a Markov chain by defining 
nodes as some set of states that spans the time series points, and allocating directed edges based 
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on temporal succession that, when weighted, can represent transitional probabilities based on 
the source data. Coarse-grained phase space approaches have seen some degree of investigation 
by Nicolis et al. in [3] and Padberg et al. in [Ij. Alternatively the time series can be parti¬ 
tioned into quartiles of amplitude as was investigated by Campanharo et al. [5]. The authors 
demonstrated that when considering time series generated by a simple map with a variable 
noise parameter, their method could be inverted using a random walk to generate time series 
from networks with autocorrelation, power spectrums and probability densities all similar to 
the original data. While coarse-graining approaches provide some degree of robustness to noise 
they also discard small amplitude information. Selecting how the data or the embedded phase 
space of the data is coarse grained will affect both the time and amplitude scale of information 
embedded in the network. As such, we note here that a multiscale coarse-graining time series 
to network analysis method could be an interesting avenue for future research. 

An alternative strategy for defining states for a transition network is the method of ordinal 
partitions, as recently proposed by Small [6], which arises naturally as an extension to the 
concept of permutation entropy originally developed by Bandt and Pompe [7] and then sub- 
sequentially extended by Cao et al. [23]. Computing the permutation entropy of a time series 
involves first embedding the data in ZD-dimensional space with embedding lag r, then converting 
each embedded vector into a symbol which is the rank order of the elements in that vector, hence 
only two parameters are required. The time series therefore become a symbolic series comprising 
some distinct set of symbols, and the permutation entropy is defined as the Shannon entropy of 
this set. It has been demonstrated that this metric can track dynamical changes in the logistic 
map in a manner similar to the largest Lyapunov exponent |7] and identify change points in the 
transient Lorenz system and in EEC data [23|. More recent investigations have developed the 
method into a multiscale approach | 23 | and the permutation spectrum test [25| — two distinct 
visual analysis methods shown to be effective in discriminating between a range of chaotic and 
stochastic dynamics. 

Additional information can be extracted from the set of rank order permutation symbols 
by mapping each distinct symbol to a node in a complex network and allocating edges based 
on temporal succession. In |6|, Small used a non-overlapping window and fixed lag r = 1 for 
embedding, and presented numerical results for a range of chaotic maps, flows and stochastic 
dynamics, demonstrating the potential for ordinal partition networks to discriminate between 
these different systems. One distinct advantage of permutation symbols over coarse-grained 
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states for time series to network transformation algorithms is that they capture relative am¬ 
plitude differences on all scales while remaining robust to noise. However, information about 
absolute amplitude is not captured in the symbol, and hence it is impossible to discern where a 
particular sequence occurred with respect to the phase space based on its permutation symbol 
alone. To overcome this, a dual symbol method was proposed by Sun et al. in [26] where 
the second symbol was a coarse grained state of the signal amplitude. The authors used an 
overlapping window and time lag r = 1. In the resulting networks, the mean degree, degree vari¬ 
ance, density and mean shortest path length were able to track changes in dynamical behaviour 
along the bifurcation spectrum of the Rossler system in a way that was visually reminiscent 
of the largest Lyapunov exponent. Other network methods and standard permutation entropy 
techniques have shown similar tracking but this has generally only been reported for simple 
maps, not chaotic ffows, hence the significance of these results. However, the use of a second 
symbol imposes the selection of a third parameter. The primary motivation for this work was 
to eliminate the need for this additional complexity yet still achieve similar results. 

When using the ordinal partition method the choice of the embedding dimension (sometimes 
referred to as the window size) is critical as this determines the maximum time scale on which 
dynamical information is captured. As noted by Sun et al. [26|, this parameter must be chosen 
in relation to the sampling rate for continuous systems, but simply using a large embedding 
dimension to capture a longer time span will make the method less robust to noise. The authors 
proposed using a time delay r > 1 as a solution to this problem, but did not attempt such a 
scheme. In the following section we define and investigate a generalised version of the ordinal 
partition time series to network transformation algorithm where r is selected by traditional 
methods used for time series embedding, and the embedding dimension D is selected based on 
simple network measures. As will be shown, this allows the permutation symbols to capture 
absolute amplitude information with respect to phase space without the need for a second 
symbol and enables simple tracking of dynamical change in chaotic ffows. 

We note here that our method is not the first proposed for constructing a symbolic sequence 
and a corresponding transition network from an embedded time series. In m and |2H| embed¬ 
ded time series points are mapped to partitions symbolised by the unit square and a binary 
sequence respectively. Like these methods, our algorithm maps embedded time series points 
from continuous phase space into disjoint sets whose union comprises the complete phase space. 
However, the primary motivation in both m and |28) was to find generating partitions — par- 
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titions for which trajectories are uniqueiy mapped to symboi sequences and therefore provide 
a compiete representation of the system dynamics — rather than constructing networks from 
time series and then using measures from network science to anaiyse the data, as is the case in 
this work and the aforementioned time series to network iiterature. Furthermore, the symboiic 
mapping procedure used in this paper is aiso fundamentaiiy different. For exampie, the ordinai 
partition method is oniy guaranteed to provide an injective mapping in the triviai case where 
D is chosen sufficientiy iarge, and thus permutation symbois made sufficientiy iong, that each 
data point corresponds to its own symbol. 

3 Method 

The generalised method of ordinal partitions is defined here. The time series, a set of discrete 
observations x = {xi, X 2 , X 3 , ...,Xn}-, is first embedded in D-dimensional space with embedding 
lag T. The elements in each of the resulting state vectors vi = (xj, Xj+t-j D+2r) •■•D-i-(D-i)r) 
are assigned an ordinal rank in descending order to form symbols Si = (tti, 7 r 2 ,..., tt/)) where 
TTj G {1,2, ...,D} and tt* / tTj / J (see Figure [^. If two or more elements of Vi are 

tied then rank for those elements is assigned based on order of appearance in the vector. The 
unique set of symbols from s are mapped to nodes in a network represented by the adjacency 
matrix A. Weighted and directed edges are allocated between nodes based on the transition 
sequence between permutation symbols, that is, s = {si, S 2 , S 3 ,..., S(„_£)_|_i)} corresponds to the 
embedded state vectors v = {vi,V 2 ,V 3 ,..., Hence, in terms of the existing literature, 

we have partitioned the time series with an overlapping window. The weight of an edge aij is 
equal to the number of times that a dynamical transition occurs from node i to node j. 

The selection of r is based on traditional criteria used for time delay embedding. In this 
study we have used the first zero of the autocorrelation of the time series because it provides 
a sufficiently good phase space reconstruction for both the Rossler time series (Section Q and 
the experimental data (Section]^. However, other methods such as mutual information could 
foreseeably be used where they provide a better reconstruction for a given time series. By 
choosing r in this manner, each permutation symbol can be interpreted as a set of inequalities 
with respect to the coordinates of the embedding phase space. For example, consider the 
case where D = 3 and the time series point Xj has the symbol Si = 1,2,3. In terms of 
the 3-dimensional embedding phase space {x,y,z} we can say that Vi, the embedded vector 
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corresponding to Xi, must have coordinates such that x > y, x > z and y > z. More generally 
the symbol Si of length D, corresponding to the time series point Xi and embedded vector Vi, 
comprises (^) inequalities, each of which defines a subspace of the D-dimensional embedding 
phase space. We can therefore say that, based on the information contained in the symbolic 
sequence alone, Vi lies within the intersect of said subspaces. These intersect regions are the 
states which define the nodes in ordinal partition networks. The number of nodes in an ordinal 
partition network, N, is bounded: N < D\ for an infinite time series, and N < n — D + 1 for a 
finite time series of length n. Moreover, the effective volume of each state reduces with increasing 
D if we only consider systems which are bounded in phase space of some fixed dimension less 
than D. While there does not yet exist a robust metric for determining the correct choice of 
D, in the cases examined as part of this study we found that networks with the most visually 
intuitive structure often corresponded with peak values of degree variance with respect to D. 
We also found the range 6 < D < 10 to be the most useful when using simple network measures 
to track changes in dynamics. 

We can also say that N is dependent on the volume of phase space occupied by the embedded 
time series, given that each node corresponds to a disjoint region of phase space and assuming 
that D is large enough that these regions are sufficiently restricted. This is essentially an 
equivalent statement to the findings presented by Amigo et al. in [8] regarding the possible 
number of permutation patterns present in a time series. Considering only the permutation 
symbols (not any interpretation of embedded phase space as they did not use a time lag) the 
authors found that whilst an infinite random sequence will contain all possible permutation 
patterns, there will always exist patterns which do not occur in periodic and chaotic time series, 
and furthermore, periodic dynamics will always be characterised by more forbidden patterns 
than for chaos. Returning to our phase space interpretation, periodic limit cycles will occupy 
less volume in phase space than a chaotic attractor and, in turn, embedded noise should occupy 
more phase space than a chaotic attractor given that both time series have the same length and 
variance. 

4 Application to the Rossler system 

We use the Rossler equations as a test system: 
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Figure 1: This figure illustrates the process of defining permutation symbols from a discrete sampled 
time series where sampled points are marked with a cross. Assume t = 9 and D = 6. Starting at xiq the 
embedded vector is nio = {xio,xiQ,X 28 ,X 3 r,X 4 e,X 55 } (blue dots) and the corresponding symbol defined 
by the rank ordering is Sio = {1,4,6, 3, 2, 5}. Likewise, Sn = {1,4, 6, 2, 3, 5} and so on. 
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We solve the equations using a fourth/fifth order Runge-Kutta method for /3 = 2, 7 = 4 and 
1201 evenly spaced values of the bifurcation parameter in the range 0.37 < a < 0.43. Each time 
series was solved with random initial conditions in the range 0 to 1 for 2 x 10 ^ points at a time 
step of 0.2, the first 10^ of which were discarded to remove transients. In the following analysis 
we use the remaining 10 ^ time series points from the x component of the system to generate 
networks. The first zero of the autocorrelation of the ensemble of time series is consistently r = 9 
so this value is used to generate all the networks in this section. Figures and show networks 
generated for different embedding dimensions from a time series exhibiting broadband chaos 
(a = 0.4) and from a period-2 oscillation (a = 0.37) respectively. Corresponding attractors are 
shown in Figures and (the colour map shall be explained in the following analysis). The 
network images are produced using a spring electrical embedding algorithm as implemented in 
Wolfram Mathematica 9 [29]. This algorithm positions vertices at an equilibrium point in the 
network space as if the network were a physical system where nodes experience an attractive 
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spring force proportional to their separation in Euclidian space if they are adjacent, and a 
repulsive force that is inversely proportional to Euclidian separation regardless of connectivity. 

Firstly we consider the chaotic case (Figures]^ and |^. For D = 6,8 ,10 the network maintains 
a tight band structure which is most reminiscent of the attractor when D = 10, but this structure 
breaks down at D = 12. Figure]^ is a colour map of the network nodes back onto the original 
attractor (not the embedding) in three dimensional phase space to illustrate how the attractor 
has been partitioned into states. When D = 6 the states are clearly observable. As expected, 
when the embedding dimension increases the states on the attractor become more numerous 
and smaller until they are difficult to distinguish when D = 12. 

We now discuss the selection of D with respect to the results presented in Figure Trans¬ 
forming the time series into a transition network is a process of mapping the temporal informa¬ 
tion into a Markov chain to obtain a compressed or simplified representation of the dynamics. 


The level of simplification is governed by D. In Figure 6(a), observe that N begins to rapidly 
approach a value close to the length of the data for 11 > 9 in networks from chaotic time series 
(red, cyan and magenta lines). In this range the phase space has been partitioned into too 
many states and the network is no longer a useful simplification of the system dynamics. We 
propose that the variance of out degrees and mean node out degree can provide an indication 
of an appropriate range for D for reasons as follows. 

In transition networks, node degree is proportional to the uncertainty about where the 
system will be after the next time step. Consider that a periodic system perfectly embedded in 
a directed transition network will have mean node out degree {kout) = 1 with variance a = 0. 
In practice these values will be larger due to the shape of the trajectories and sampling time 
step which both impact on the capacity for any phase space partitioning method to accurately 
represent the dynamics (e.g. if the length of a segment of a trajectory for a single time step 
skips over a state in the transition network because At is too large). For chaotic dynamics 
both (kout) and a will be nonzero due to the stretching and folding of the trajectories. If cr 
is maximised then we might assume that information about transitional probabilities is being 


captured on as wider scale as possible for the given dataset. Figure 6(c) shows clear peaks in a 
against D for the chaotic Rossler time series. The cyan line, which corresponds to the networks 
in Figure peaks at H = 9 then falls away rapidly. Generally, when D was selected close 
to the peak value for a we found the networks for chaotic systems most closely resembled the 
attractor, but for larger D the visually coherent network structure begins to break down. 
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Figure 2: Networks generated from a chaotic Rossler time series as shown in Figure (a = 0.4) using 


the ordinal partition method with t = 9 and (a) 


£> = 6 , 


(b) 


D = 


(c) D = 10 and (d) 


D = 12. 



Figure 3: Networks generated from a period-2 Rossler time series as shown in Figure(a = 0.37) using 


the ordinal partition method with r = 9 and (a) D = 6, (b) D = 8, (c) D = 10 and (d) 


D = 12. 


Peaks also occur in the plots for mean degree against D (Figure |6(b)[ ) providing a further 
indication for parameter selection. To explain this consider an alternative interpretation of the 
permutation symbols as information about where a time series point is with respect to a history 
of D steps of length r. Due to the exponential divergence of trajectories in chaotic attractors, if 
this history is too long then each state will correspond to fewer and longer sections of trajectory 
that will have a limited number of transitional possibilities (low node degree) such that the 
network is no longer a useful simplification of the dynamics. 

Networks have ring structures for periodic regimes as shown in Figure |3(c) and |3(d)| The 
corresponding period-2 limit cycle is shown in Figure The colour map again demonstrates 
the addition and constriction of states in phase space as D increases, however the number 
of nodes in the network increases at a far slower rate than in the chaotic case (Figure [6(a)[ ). 
Large peaks in a and {kout) are not present as they were for chaotic regimes. Note that the 
embedding dimension must be large enough to ensure that two or more independent segments 
of trajectory do not both pass through a single state, otherwise the network will include a false 
transitional edge — an edge connecting two or more states that are not temporally adjacent. A 
false transitional edge is clearly observable in a network generated from a periodic time series 
because the ring structure will fold onto itself as shown in Figures 3(a) and|3(b)| 
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(a) 


(b) 


(c) 


(d) 


Figure 4: Time series points in phase space for a chaotic Rossler system (a = 0.4). The nodes from 
networks generated using this time series with D — 6, D = 8,D = 10 and D — 12 (see Figure 
have been colour mapped back to the attractor using one of seven colours in subfigures |(a)l |(b)| |(c)| and 
m respectively. Temporally adjacent nodes are assigned different colours such that distinctly coloured 
regions on the attractor are representative of the states defined by the permutation symbols in phase 
space. 



Figure 5: Time series points in phase space for a period-2 Rossler system (c 
procedure is the same is in Figure but for the networks shown in Figure 


0.37). Colour mapping 





(a) (b) (c) 

Figure 6: Network measures plotted against the embedding dimension for the Rossler system in different 
dynamical regimes: period 2, a = 0.37 (blue line); period 3, a = 0.41 (green line); multiband chaos, 
a = 0.39 (red line); broadband chaos, a = 0.4 (cyan line); and broadband chaos, a = 0.42 (magenta 
line). Network measures shown are M number of nodes, m mean out degree, and |(c)| variance of out 
degrees. 
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Figure 7: Network measures plotted against the length of the dataset used to generate an ordinal 
partition network for the Rossler system in different dynamical regimes: period 2, a = 0.37 (blue line); 
period 3, a = 0.41 (green line); multiband chaos, a = 0.39 (red line); broadband chaos, a = 0.4 (cyan 
line); and broadband chaos, a = 0.42 (magenta line). Network measures shown are | (a) [number of nodes. 


(b) mean out degree, and (c) variance of out degrees. 


To test the dependence of our method on time series length we generated five additional 
time series from different dynamical regimes each with 10® points with transients removed, 
and mapped these to networks using varying amounts of the data. Ideally there should be 
enough points in the time series such that N n for an appropriate value of D. This is 
to say that the dataset should contain a sufficiently complete representation of the dynamics. 
Figure shows the number of nodes N, the variance of out degrees a and the mean out degree 
{kout) plotted against the length of the time series used. In the periodic case these properties 
converge for relatively short time series (less than 10^ data points). As expected, networks 
generated from chatoic time series take far longer to converge because more time series data 
is required to capture a sufficient portion of the attractor. However, a and (kout) still provide 
good discrimination between the different dynamical regimes for n = 10^. 


We have plotted the bifurcation diagram(Figure 8(a)) and the largest Lyapunov exponent 
(Figure [8(b)| ) of the Rossler system from the generated time series using the extrema and lyapk 
functions from the TISEAN software package m respectively. The system undergoes a period 
doubling route to chaos then passes through several periodic windows including the large period- 
3 window at a ~ 0.41. Other periodic windows are denoted by the dotted grey lines. Networks 
have been generated for each time series with D = 8. This value was selected based on Figures 
|6(b)| and 6(c) from which it appears that there should be good discrimination between different 
dynamical regimes based on {kout) and a for this choice of embedding dimension, although it 
may not be the optimal choice for individual time series in the dataset (i.e. not all of the periodic 
ring networks have unfolded at Z) = 8). Figures [8(d)| and 8(e)| show that {kout) and a both 
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exhibit sensitivity to system dynamics, as they appear to track the relative change in the largest 
Lyapunov exponent and detect all of the periodic windows. Similar but less effective tracking 
is apparent from N, the number of nodes in the network, however this is only a measure of how 
many different permutation symbols are present in the times series and therefore is related to 
the volume of phase space occupied by the embedded attractor rather than characteristics of 
temporal succession. The mean shortest path length and network diameter (maximum shortest 
path length) both display sensitivity to dynamical changes. For example, a pronounced step 
change is evident in both of these measures at the point of the first period doubling bifurcation 
and there are peaks at each of the periodic windows. In summary, this set of results demonstrates 
that while {kout), C; mean shortest path length and diameter all share the deficiency that they 
do not provide an absolute criteria for discriminating between periodic and chaotic dynamics, 
they have the potential to be useful as an indicator for dynamical discrimination in a relative 
sense, and for detecting change points. 

When the time series is corrupted with additive white Gaussian noise, (kout) and a become 
far less effective in discriminating different dynamical behaviour. These simple network prop¬ 
erties are global averages of local node properties which represent transitional possibilities for 
a single time step, hence these measures will be sensitive to noise. However, from a qualitative 
perspective, Figuresand [T0| show that the distinct ring and band structures which we observed 
in the noiseless case for periodic and chaotic dynamics respectively are fairly well maintained 
even in the presence of significant additional noise. We postulate that network measures which 
operate on an intermediate scale such as motif distributions |12j or subgraph expansion rates [3] 
will be far more effective at quantifying these observable differences in network structure. 


5 Application to experimental data 


We now present results of the method as applied to experimental time series data from an 


externally driven diode resonator circuit (see Figure 11) as previously reported in m- Each 
time series comprises 65536 observations of the voltage Ur. Time series were recorded for 1000 
evenly spaced values of the control parameter — the amplitude of the driving sinusoidal voltage 
Uq — in the range 3F < Uq < 5V. The system begins in period-3 oscillation (Figure 12(a)) 


and undergoes a period doubling bifurcation into period-6 (Figure 12(b)[). This is followed 


by a period doubling cascade into multiband chaos (Figure 12(c)) and then an interior crisis 


15 









(a) 



Bifurcation paramaler a 




0.37 0.38 0.39 0.4 0.41 0.42 0.43 

Bifurcation parameter u 


n 




-nv 1 1 




Bifurcation parameter a 


(d) 


(e) 


n 






w 




Bifurcation parameter u 


(f) 


(g) 


Figure 8: (a) The bifurcation diagram for the Rossler system and (b) the largest Lyapunov exponent 


for the range 0.37 < a < 0.43. The vertical dotted lines correspond to periodic windows. Networks were 
generated for each time series with r = 9 and D = 8. Plotting (c) the number of nodes, m the mean 
out degree, (e) variance of out degrees, m mean shortest path length, m and network diameter over 
the same range demonstrates that the dynamical information is embedded in the network structure. 
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Figure 9: Networks generated from a chaotic Rossler time series (a = 0.4) with r = 9 and D — 10 for 
increasing levels of additive white gaussian noise: [(^ 0 .5%, |(b)| l%, |(c)| 5%, and |(d)| 10%. Noise variance 
is expressed as a percentage of the variance of the original signal. 



Figure 10: Networks generated from a period-3 Rossler time series (a = 0.41) with r = 9 and D = 10 
for increasing levels of additive white gaussian noise: |(a)| 0.5%, |(b)| 1%, |(c)| 5%, and |(d)| 10%. Noise 
variance is expressed as a percentage of the variance of the original signal. 
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(a) 


(b) 


(c) 


(d) 


Figure 12: Attractors from time delay embeddings of time series generated by the experimental diode 
resonator circuit for different values of the driving voltage amplitude Uq. Each time series was embedded 
with delay t = 8. This figure shows the system in (a) period-3 oscillation, t/g = 3F; m period-6 
oscillation, Uq = 3.7F; (c) multiband chaos, Uq = 4F; and m chaos-chaos intermittency after the 
interior crisis, Uq = 4.5F. 


at Uq ~ 4.05 into chaos-chaos intermittency [32j (Figure 12(d)[ ). Networks for these different 
dynamical regimes are shown in Figure Embedding lag is set to r = 8. The period-3 and 
period-6 time series map to ring structures. In the period-6 case it was necessary to select a large 
value for the embedding dimension, D = 16, to unfold the ring structure (i.e. there are no false 
transitional edges in the network) because of the closeness of trajectories in phase space (see 
Figure [l2(b)[ ). The multiband chaotic time series exhibits a narrow flat band structure with 
a clear pinch point that likely corresponds to the folding region on the attractor. Following 
the interior crisis the attractor (Figure 12(d)[ ) has a corresponding tube like network structure, 
consistent with the results from the Rossler system. 

The size of the networks grow with D in the same manner as the Rossler system with the 
exception that the periodic networks begin to grow at a similar rate to the chaotic networks 
after = 15 (Figure 14(a)[ ). This anomaly is reflected in the plots for {kout) and a against 
D, shown in Figures 14(c) and |14(b)] respectively, which both have have peaks for the periodic 
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Figure 13: Networks corresponding to the time series shown in Figure 12 The embedding dimensions 


used for the period-3, period-6, multiband chaotic and chaos-chaos intermittent time series were [Ml 
D = 10, H D = 16, |(c)| D = 14, and |(d)H(e)| D = 7 respectively. Two views are given for the network 
from the chaos-chaos intermittent time series where |(d)| is a top down view and (e) is a side view of the 
network’s tube like structure. 





(a) 


(b) 


(c) 


Figure 14: Network measures plotted against the embedding dimension for the diode resonator time 
series data in different dynamical regimes: period 3, Uq = 3V (blue line); period 6, Uq = 3.7V (green 
line); multiband chaos, Uq = iV (red line); and chaos-chaos intermittency, Uq = 4.514 (cyan line). 
Network measures shown are (a) number of nodes, (b) mean out degree, and (c) variance of out degrees. 


regimes after this point but otherwise exhibit similar trends to the periodic Rossler time series. 
These later peaks are likely due to low levels of noise in the experimental time series. When D 
becomes large, the states will effectively span a region of the phase space that is smaller than 
the cross section of the noisy period trajectory therefore resulting in a rapid increase to a peak 
in {kout) and a, just as occurs for the chaotic time series at lower values of D. 

The full bifurcation spectrum of the data set is plotted in Figure |15(a) using the extrema 
function from the TISEAN software package. The largest Lyapunov exponent Ai, computed 


using the lyapk function is shown in Figure 15(b) The brief range of the bifurcation parameter 
for which Ai becomes negative after the first period doubling bifurcation is an error due to poor 
parameter selection for those particular corresponding time series (the exponent was computed 
with fixed parameters over the entire dataset for practical reasons). We then generated networks 
for each time series with r = 8 and D = 8. Network measures are plotted against the bifurcation 


spectrum in Figures 15(c) 15(g) The size of the network exhibits sensitivity to both the period 
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doubling bifurcation at Uq k. 3.6, the period doubling cascade to chaos for approximately 
0.38 < Uo < 0.405, and undergoes a step change at the interior crisis, reflecting the filling of 
the attractor. As was the case in the model system, (kout) and a provide robust tracking of 
dynamical change similar to Ai, and also appear sensitive to the period doubling bifurcation and 
the interior crisis. The mean shortest path length and network diameter both undergo a clearly 
discernible step change at the interior crisis, with the latter also exhibiting a peak value at the 
change point. Both of these results are easily understood in terms of the relationship between 
the networks and phase space as follows; additional nodes and edges are created immediately 
after the crisis, corresponding to the intermittent chaotic trajectories that begin to fill the 
space between the bands of the pre-crisis attractor in phase space. These new nodes and edges 
become shortcuts in the network. The spike in diameter corresponds to the small number of 
time series which have only a limited number of trajectories in between the bands of the pre¬ 
crisis attractor because they are in the immediate vicinity of the crisis and we are dealing with 
finite non-stationary data. These trajectories will form new strands in the network which are 
only connected to the main structure where they leave and rejoin the bands of the pre-crisis 
attractor, and hence these trajectories will have a significant impact on the network diameter. 
Moreover, these strands or subgraphs will have a far lower degree and degree variance than the 
remainder of the network, hence why the value for mean out degree and degree variance also 
dips at the interior crisis. 

6 Discussion and Conclusions 

We have defined a generalised form of the ordinal partition time series to network transformation 
algorithm by specifying partitions with time lagged elements. By selecting the time lag using 
traditional time series embedding techniques, each ordinal symbol represents a region of the 
embedded phase space, and the networks are therefore a Markov chain representation of the 
dynamics. 

We applied the new method to chaotic flows, the Rossler system and experimental data from 
a diode resonator circuit, and found that dynamical information was successfully embedded in 
the network structure. Due to the nature of the transformation, the network will contain both 
topological and temporal information. Moreover, the mean out degree and the variance of 
out degrees appear to track the relative change in the largest Lyapunov exponent while also 
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Figure 15: (a) The bifurcation diagram constructed from the diode resonator dataset and (b) the 


largest Lyapunov exponent for the range 3V < Uq < 5V. Networks were generated for each time series 
with T = 8 and D = 8. Also shown are plots of the |(c)| number of nodes, |(d)| the mean out degree, |(e)| 
variance of out degrees, (f) mean shortest path length, and (g) network diameter over the same range. 
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displaying sensitivity to period doubling bifurcations. As described in Section the reason 
for this tracking is that node degree reflects transitional probability in the partitioned phase 
space and is therefore sensitive to the exponential divergence of trajectories in chaotic systems. 
Furthermore, the degree variance of ordinal partition networks derived from chaotic systems 
will be large due to the stretching and folding processes in the attractor. Unfortunately both 
of these simple measures are easily skewed by noise because they are local node properties in a 
transition network and therefore are merely global averages of temporal behaviour for a single 
time step. 

However, graphical evidence showing relative consistency in network structure despite sig¬ 
nificant additive noise suggests that there should exist measures of network structure that are 
robust to noise. In |3j Padberg et al. proposed analytical links between the Lyapunov exponents 
and network structure, approaching the problem by evenly partitioning phase space and com¬ 
paring the divergence of trajectories to subgraph expansion rates. Whilst the ordinal partition 
method does not partition phase space into evenly sized and bounded regions, as was the case 
in Padberg’s paper, measuring the growth of a subgraph over a timespan of intermediate length 
should provide a more robust indication of the divergence of trajectories in the presence of 
noise. We note here that the possibility of a link between the Lyapunov exponents and network 
properties was also proposed by Nicolis et al. in [3] with respect to transition networks built 
from chaotic maps, and by Donner et al. in |15j with respect to recurrence networks, but we 
are not aware of any subsequent work which investigates these ideas in detail. 

We also found that mean shortest path length and network diameter track dynamical changes 
and undergo a step change for an attractor merging crisis in an experimental data set. In this 
work we have restricted our attention to network measures that do not depend on edge weight. 
Edge weights will be considered in future investigations. 

To conclude, we propose that the ordinal partition method, which explicitly captures tem¬ 
poral information, is complimentary to existing proximity network time series analysis methods, 
which are better suited for analysis of attractor topology. However, unlike proximity networks 
and visibility graphs, whose size is dependent solely on the length of the time series, the size of 
an ordinal partition network is dependent on attractor topology. Furthermore, the parametric 
simplicity of the generalised version of the ordinal partition algorithm presents an advantage 
over proximity network algorithms and the dual symbol ordinal partition method. 
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